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Dedicated to Professor Yuri Prokhorov on the occasion of his 85th birthday 
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Abstract. In this paper we consider asymptotic expansions for a class of sequences of sym¬ 
metric functions of many variables. Applications to classical and free probability theory are 
discussed. 


1. Introduction 

Most limit theorems such as the central limit theorem in finite dimensional and abstract 
spaces and the functional limit theorems admit refinements in terms of asymptotic expansions 
in powers of n^ 1 / 2 , where n denotes the number of observations. Results on asymptotic 
expansions of this type are summarized in many monographs, see for example [3]. 

These expansions are obtained by very different techniques such as expanding the char¬ 
acteristic function of the particular statistic for instance in the case of linear statistics of 
independent observations, see e.g. Ch. 2, in [3] and § 1, Ch. 6, in m ■ Other techniques com¬ 
bine convolutions and characteristic functions to develop expansions for quadratic forms, see 
e.g. HU and [20], or for some discrete distributions expansions are derived starting from a com¬ 
binatorial formula for its distribution function, see e.g. [6j and m- Alternatively one might 
use an expansion for an underlying empirical process and evaluate it on a domain defined by a 
functional or statistic of this process. In those cases one would need to make approximations 
by Gaussian processes in suitable function spaces. 

The aim of this paper is to show that for most of these expansions one could safely ignore 
the underlying probability model and its ingredients (like e.g. proof of existence of limiting 
processes and its properties). Indeed, similar expansions can be derived in all of these models 
using a general scheme reflecting some (hidden) common features. This is the universal collec¬ 
tive behavior caused by many independent asymptotically negligible variables influencing the 
distribution of a functional. 

The results of this paper may be considered as the extension of the results given by 
F. Gotze in |8j where the following scheme of sequences of symmetric functions is studied. 
Let h n (e, ...,E n ),n > 1 denote a sequence of real functions defined on M 71 and suppose that the 
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following conditions hold: 


( 1 . 1 ) 

hn+1 (^1 5 •••? £j •) 0 5 £j-\- 1 1 

■ ■ j £n ) — h n (£l, ..., £j , Sj -\-\, • • 

( 1 . 2 ) 

hn 1 ? • • • ? £j ? • • • ? £n ) 

= 0 for all j = 1 ,..., n; 

£j=0 

(1.3) 

hn (^7r(l) ’)•••'> ^7r(n)) •••? &n ) ^ 

where S n 

denotes the symmetric group. 



Consider the class of examples. Put 


(1.4) h n {e i, EpF(ei(Sx x — P) + ... + £ n (dx n — P)), 

where F denotes a smooth functional defined on the space of signed measures and Xj denote 
random elements (in an arbitrary space) with common distribution P. Thus h n is the expected 
value of the functional F of a weighted empirical process (based on the Dirac-measures in 
X\,, X n ). Here property (ED is obvious. Property (11.21) . that is the locally quadratic 
dependence on the weights around zero, is a consequence of the smoothness of F and the 
centering in P-rnean of the signed random measures 5xj — P and ED follows from the 
identical distribution of theXj-s. Properties ED and ED suggest to consider the argument 
ej of h n as a weight which controls the effect that Xj has on the distribution of the functional. 
In [8] the first author considered limits and expansions for functions h n of equal weights 
£j = n -1 / 2 ,1 < j < n with applications to the case ED- Those results explained the common 
structure of expansions for identical weights developed e.g. in [3] and I7lf9lfl2l . In the following 
this scheme will be extended to the case of non identical weights £j. like in the class of examples 
where the functions h n are given by ED- Moreover, the dependence of F on the elements Xj 
may be non linear. 

Denote by e the n-vector £j,l < j < n and by e d := X)j=i £< ji d — 1 the d-th power 
sum. In the following we shall show that ED-ED ensure the existence of a ’’limit” function 
hoo(£ 2 , Ai,..., X s ) as a first order approximation of h n together with ’’Edgeworth-type” as¬ 
ymptotic expansions, see e.g. the case of sums of non identically distributed random variables 
in Ch. 6 , [193. These expansions are given in terms of polynomials of power sums e d , d > 3. The 
coefficients of these ’’Edgeworth”-Polynomials, defined in (12.91) below, are given by derivatives 
of the limit function hoo at Ai = 0 ,..., \ s = 0. 


Remark (Algebraic Representations). In case that h n is a multivariate polynomial of e, satisfy¬ 
ing ED-ED, we may express it as polynomial in the algebraic base, e d ,d> 1 , of symmetric 
power sums of e with constant coefficients. Note that 



— $d, 1 ) 


where = 1, if d = 1 and zero otherwise. Hence, (11.21) entails that in this representation h n 
is a polynomial of £ d ,d> 2 only and does not depend on e 1 . Now we may write 


h n (e ) = P £ 2 (e 3 ,...,e n ), 


where P e 2 denotes a polynomial with coefficients in the polynomial ring C[e 2 ] of the variable 
e 2 . Restricting ourselves to the sphere e 2 = 1 for convenience, P £ 2 is the desired ’’Edgeworth” 
expansion, provided we introduce the following grading of monomials in the variables e d , d > 3 
via deg(£ rf ) := d — 2 and expand the polynomial h n in monomials of £ 3 ,... ,£ n by collecting 
terms according to this grading. 
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1.1. Notations. Throughout the paper we will use the following notations. We denote e d := 
Yli=i £ f and |e| rf := J2i =1 \ £ i\ d - Furthermore, we denote by (e)d and |e|rf the cl-th root of e d 
and \s\ d respectively, i.e. (e)^ := (e rf ) 1//rf and |c|rf := (\s\ d ) 1 ^ d . By c or C with indices or 
without we denote absolute constants, which can be different in different places. Let D a , 
where a is a nonnegative integral vector, denote partial derivatives tKt • • •, and finally let 

u£ i Cf£m 

E m _ 

j=i a r 


2. Results 


Introduce for an integer s > 0 the functions, 


( 2 . 1 ) 


hoo(^h 


lim h k+s 

k— »oo 



Vic’'"’Vie) ' 


Thus we consider the limit functions of h k+s as k —» oo, where all but s arguments are equal, 
asymptotically negligible and taken from a k — 1-sphere. In Theorems below we give sufficient 
conditions for the existence of the limits. The following theorem is an analogue of the Berry- 
Esseen type inequality for sums of non identically distributed independent random variables 
in probability theory, see e.g. Ch.6 in 021- 


Theorem 2.1. Assume that h n (-),n > 1, satisfies conditions CLU) CHD and with some posi¬ 
tive constant B we have 


( 2 . 2 ) 


D a h n {e i, ...,£ n )\ < B, 


for all £i,..., £ n , and for all a = (or, ..., a r ) with r < 3 such that 


> 2, j = 1,..., r, 2) < 1. 

3 =1 

Then there exists /loodc^) defined by m with s = 0 and 

\h n (£i, ...,e„) - /ioo(k| 2 )| < c - B ■ max(l, l^l^kl 3 , 


where c is an absolute constant. 


In case that £ depends on n, this theorem shows that if 
(2.3) lim |e |3 = 0 

n—>■ oo 

then h n {£ i, ...,£ n ) converges to the limit function /loodeb)) which depends on sq, ...,£ n via the 
/ 2 -norm |e |2 only. This means that the sequence of symmetric functions (invariant with respect 
to S n ) may be approximated by a rotationally invariant function (invariant with respect to 
the orthogonal group O n ). 

Note though that if 112.31) holds, Theorem O doesn’t provide an explicit formula for the 
function h oc (\£\ 2 ), but guarantees its existence. 

Remark. Investigating distributions of weighted sums, it has been shown in pT6l Lemma 4.1], 
that (12.31) holds with high probability under the uniform measure, see as well inequality (13.41) 
below. 
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Proof of Theorem \2.1[ We divide the proof into three steps. In the first step we substitute 
each argument Sj by a block of the length k of equal variables £j/y/k. This procedure doesn’t 
change the / 2 -norrn |e| 2 . After n steps we arrive at a function which depends on nxk arguments 


(2.4) 

We show that 


t'nk 


S\ £i S n S n \ 


(2.5) 


^n(^l? •••? £n) h' 


nk 


£\ £ i £ n £ n 


< c • B • max(l, |e||)|e| 


Hence this approximation step corresponds to Lindeberg’s scheme of replacing the summands 
in the central limit theorem in probability theory by corresponding Gaussian random variables 
one by one (see, e.g., |T8] and further development in [|2] and extension to an invariance principle 
in HD- Here the replacement is performed not with a Gaussian variable but with a large block 
of equal weights of corresponding ^-norm. In the second step , still fixing n, we determine the 
limit of the sequence of functions (12.41) . as k goes to infinity. We will show that in this case 
the limit depends on e\, ...,e n , through its ^-norm \e \2 only. It will be shown that 


( 2 . 6 ) 


, i _£ 1 £ 1 e n 

nk[ 


£ n \ _ h ( l £|2 |£|2 

'"’VkJ k \Vk'""Vk 


< c(e) ■ B ■ k~ 1/2 , 


where c{e) is some positive constant depending on e only. 

Finally, we may apply the arguments from Proposition 2.1 in [8j. We show that there exists 
some function /loode^) such that 


(2.7) 


hk 




< c(e) • B ■ k~ l/2 . 


From (E3|)- E2D it follows that 

\h n (£i, ...,e n ) - Tioo (|^| 2 )| <C ■ B ■ max(l, |£||)|e| 3 + c(e) • B ■ k~ 1/2 . 


Taking the limit fc —» oo we conclude the statement of the Theorem. In the following we shall 
provide the details for proof of the steps outlined above. 

First step. We introduce additional notations. For simplicity let us denote f k {5\, ...,5 k ) '■= 
h'n+k—l[5l,...,5k,E2,...,£n) and 

h ■= (5i,...,5 k ) := , <5° := (,) := (ei,0,...,0). 

Using Taylor’s formula we may write 


a&) - ml) = £ - $) +1 E ^ww-v> ~ 5 ° )(S ‘ ~ J °> + R * 

j =1 J 3,1 =1 3 1 


where R^i is a remainder term which will be estimated later. In what follows we shall denote 
by i? 3 j, for some i € N, the remainder terms in Taylor’s expansion. By (|l,ip all summands in 
the first sum equals zero except for j = 1. Consider the second sum. If j ^ l and j,l ^ 1 then 
the corresponding summand equals zero. Condition m yields 


d_d_ 

85j 85i 


fk(5° k ) = 0 
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provided that j ^ l, j, l 7 ^ 1 and 


ds/ k ^ Rs2 ' 


1 =2 


for all l = 2, k. Expanding the non zero terms in the first and second sum we obtain 

^MM) = | S . =0 «? + fl33, 

|U© = ^A(s°)|jo.„ + A34. 

Applying condition (11.311 we may sum the coefficients of the second derivatives of f k and get 


( 2 . 8 ) 


£1 


£1 


Vk £l ) + 2 


1 / £l 


Vk 


— + 


k — 1 ( £1 

Vk 


= 0 . 


It remains to investigate the terms R 31 , l = 1,..., 4, and show that 

\Rx\ <C- J B-(|c 1 | 3 + | £l | 4 + |c 1 | 6 ). 


Let us consider R:$ \. First we note that R 31 is the sum of the third derivatives of f k at some 
intermediate point 5 k : 

k ft 3 n 

j,l,m= 1 

If the partial derivative with respect to 6j (or 5i,5 m ) is of order one we need to add an additional 
expansion with respect to this variable around zero using (11.21) . In this way, we finally get 


E 

j,l,m= 1 


d 3 


ddjdSiddr 




< C ■ B ■ (|ei | 3 + |ei | 4 + |ci| 6 )- 


The other terms, that is R 31 , l = 2,3,4, may be treated in a similar way.Repeating this proce¬ 
dure n — 1 times we arrive at the function (12.41) and the bound (12.51) . 

Second step. The proof is similar to the previous step. Here n is fixed and we derive bounds 
in terms of powers of A© 1 / 2 . Applying assumption (11.31) we may rearrange the arguments in 
Kk(-) and get 


£1 £1 


1 I — ± — _L n ( ~'Ti 1 1 j — ± —it — ± —n 1 

”"nk I 7=5 •••? 7•**’ ’ •••’ 7 t ) = I 7= 5 •••? 7= 5 •••? 7=5 •••? 7= 


vst"’ Vk Vfc’"'’ wsr"’ vf'"’ %/£ 


Cl 


Cl 


fn($ I 5 •••? ^n) •— ( ^1? •••5 


Let us denote 


and choose the following argument vectors 

^1 


6 i £i 


Vk''"' Vk''" 1 Vk''"’ Vk 


5 n := (5i,..., S n ) := 


Vk""' Vk 




£ 2 
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We shall estimate f n {8 n ) — by repeating the same arguments as in the first step. We 

omit the details, but would like mention that instead of (12.811 we shall use here that 


kb f £i_ _ kb \ 1 f £i 

s/k \Vk Vk) 2 \y/k 


./u L/i: 


y/k 


1 ]=2 Wk 


= o. 


Thus, we finally arrive at the following bound 

\fn(5n) ~ fn(S° n )\ < C(S) ■ B ■ k~l 


Repeating this procedure k — 1 times we obtain the bound (12.611 . 


Third step. We consider the difference of the value of hk at the point 

& = (kbfc“ 1 / 2 i”-»kbfc -1/2 ) 

and the value of h k+r at the point 

£fc+r = (kb( fc + r )” 1/2 > kb( fc + r )” 1/2 )- 

We show, similar to the arguments in the previous steps, that (compare as well the proof 
in [ 8 ] [Proposition 2.1]), 

k-\-r—1 

I hk(e k ) - h k+r (e k+r )\ < c(e) ■ B ■ ^ p~ 3/2 . 

p=k 

Thus, h k {e k ) is a Cauchy sequence in k with a limit, say /loo(kb)- This fact concludes the 
proof of the theorem. □ 


To formulate the asymptotic expansion of the function h n (-),n > 1, we have to introduce 
additional notations. We introduce the following differential operators by means of formal 
power series identities. Define cumulant differential operators k p (D) by means of 


E 

P =2 


P 


!-h 


: p k p (D ) = In 


1 + J 2 p'~ 1 £ p D p 


p=2 


in the formal variable e. One may easily compute the first cumulants. For example, k 2 = 
D 2 ,k 3 = D 3 ,k 4 = D 4 — 3 D 2 D 2 . Define Edgeworth polynomials by means of the following 
formal series in n r , r r and the formal variable e 

oo / oo 

^e r P r (r*K*) = exp ( ^ 7-!~ 1 e r ~ 2 /yr r 
r=0 \r =3 


which yields 


= ^2 m\ 1 ^2 (ji + 2)! 1 T jl+2 n jl+2 

™= 1 31, —,3m 


X (j 2 + 2)! 1 Tj 2+2 Kj 2 +2 • • • (jm + 2 )! 1 T,- ra + 2 Kj m +2, 


(2.9) 
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where the sum j m extends over all m-tuples of positive integers (j 1 , ■ • •, j rn ) satisfying 

Y^LiJq = r and K * = ( K 3,...,Kr+ 2 ),T* = (t 3 , T r+2 ). For example, 

Pl(f*k*) = ^t 3 k 3 = ^rfP> 3 , 

O 0 

(2.10) p 2 (n^) = ^ r 4K4 + ^t 3 2 n 3 K3 = ^t 4 (F> 4 - 3D 2 D 2 ) + -^t 3 2 P> 3 F> 3 . 

In the following theorem we will assume that e is a vector on the unit sphere, i.e. |e| 2 = 1. 
It is also possible to consider the general case |e| 2 = r, r > 1, but then the remainder terms 
will have a more difficult structure. In what follows we shall drop the dependence of on 
the argument |e| 2 in the notation of this function. 


Theorem 2.2. Assume that h n (ei ,..., £ n ), n > 1, satisfies conditions (11.11) . (11.21) and 
together with |e| 2 = 1. Suppose that 

(2.11) \D a h n (£i,...,£ n )\ < B, 


for all £i,..., £ n , where B denotes some positive constant, a = (ai, ...,a r ),r < s, and 

r 

aj>2, j = l,...,r, ^(a i -2)<s-2. 

3 =1 


Then 

s -3 

hn (^11 £ 71 ) — ^oo T ^ ^ Pi (^ N* )/loo (, ..., A;) | ^ 1= =/ \ ;= q d - P'S j 

Z =1 

where Pfie* k*) is defined in ([2.90 with e* = (e 3 ,..., e z+2 ), k* = (« 3 ,..., k;+ 2 ) and 


R s \ < c s - B ■ |e| s 


with some absolute constant c s . 


As an example consider the case s = 5. Then by (12.100 


£3 Q?> 

(2.12) h n (s\^ £77,) — /loo H I a=o 

V / a 4 Q d 2 d 2 \ (£ 3 ) 2 d 3 a 3 

24 \9Af “ 3 5Af 9AfJ + 72 dA 3 3A 3 


+ 


^oc(Ai, A 2 )| Ai=0 Aa=0 + 0(\e\ 5 ) 


Before we start proving Theorem 12.21 we have to introduce one more notation. For any 
sequence r p ,p > 1, of formal variables define P(t*k*) as a polynomial in the cumulant operators 
k p multiplied by t v by the following formal power series in p: 


3= 2 


(2.13) Pjpi : = exp 

3 =0 

For example, Po = l,Pi = 0,P 2 = \t 2 D 2 ,P 3 = | t 3 D 3 , and 

1 / t-, 4 n t-v 2 t->2\ , 1 2 n n 
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Furthermore, one may verify that functional identities of exp in (12.1311 yield the identities 
(2.15) ^2 Pj ( T * K *)Pj ( r * K *) = Pr{(n + r')«*). 

j+l=r 

There is a relation between the Edgeworth polynomials P r (-) and P r (-) which may be expressed 
in the following relation. 


Statement 2.3. We have 


(2.16) 


^[-P r (T*fv*)]z = y^P r (r»/t»), 


r —1 


r—1 


where [•]; denotes the sum of all monomials rf 1 • • • in -P r (r*K*) such that p\ + 2 p2 + ... + 

(r + 2 )p r+2 < l. 

We shall use (12.161) in the proof of Theorem 12.21 The following Lemma allows us to rewrite 
the derivatives of h n {ei,...,e n ) via derivatives in additional variables using the definition of 

P r . 

Lemma 2.4. Suppose that the conditions mu, mu and mu hold. Then 

m i d 

2 ^^Me,e2,...,£n)| e= o(V ~ £J ) 


3=2 


- e*)n*(D))h n+m (\i,\ k ,£,£ 2 , ...,£ n )\ Xl= _ =Xm=0 + O (e m ) 


r =2 


Proof. This relation is a consequence of the following simple computations: 

m 

T Priiv* - £*)nPD))h m+n ( 0^0, £, e 2 , ...,£„) 


1127141 


J2 E PrPv* -£*)K*(D))P r (s*KPD)) 

7=1 l+r=j 

r> 1 

x h m + n ( 0, . . J, 0 , £2, £n) + O ( e?n ) ■ 

m + 1 
m 

2 (P r (?/*«*(£))) - P r (£*^(T>))h m+fe ( 0 , ..., 0 ,£ 2 , ...,£„) + O (£ m ) • 

1 m + 1 

_ m o 

= E .'JUi' - o+o(o ■ 


<2451 


3=2 


□ 


Proof of Theorem 2.2. We prove this theorem by induction on the length of the expansion. 
Consider the difference 


hnipli ••••> £n) h 


nk 


( \ 
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and divide it into a sum of n terms, replacing successively the argument £j,j = 1 ,... ,n by 
the fc-vector (fc _1 / 2 £j,&: _1 / 2 £j), similar to the arguments used in the previous Theorem 12.II 
We start with the case j = 1 and denote h k (Si, ...,S k ) := h n+k -i(Si ,..., 8 k, £ 2 , ■ ■■, £«)■ Set 

h ■= (Si,-,6 k ) := , Si := (6°, ...,6° k ) := (d, 0,..., 0). 

A Taylor expansion yields 

hk(S k ) - hk(6l) = J2 a*~ 1 D a hk(&)m-&r + Ri,s, 

0 <\a\<s 

with a remainder term i?i )S such that |i?i )S | < c s ■ B ■ |ci| s . To simplify our notations we 
introduce the following convention. By R[,l > 1 we shall denote a remainder term which 
is of order 0(|£^) omitting the explicit dependence on B. By R\j,l > 1 we shall denote a 
remainder term of order (D(\£\\ l ). 

In order to use condition (11.21) we expand each derivative D a hk(S k ), where a = (a.j 1 ,..., a Jp ), 1 < 
j\ < ... < j p < k, around 5j r = 0, r = 1, ...,p. This yields 

(2.17) D a h k (6l)= P^D^hk^kMY + Ri'S, 

0 <\a\+\fi\<s 

The binomial formula implies 

£ A ft-nW = ^<f! r -rn. 

j-\-k=r,j> 1 

Applying this relation to (12.171) we get 

k 

h k (S k )-h k (Sl)= £ 7r 1 ^(0,..,0)n^-(^]+^- 

0<|7|<s i =1 

In order to use the induction assumption which will be formulated later in terms of the function 
values h k (5_k), we have to use expansions and derivatives in additional variables at zero. 
Introduce for j = 1,..., k and p = 3,..., s — 1, 

A p j := S p 3 - (<5°) P and A* := (A?,..., Af 1 ). 

Applying Lemma 12.41 we get 

(2.18) h k (S k ) - h k (S°k) = Y^ P n( A >*) ' ' ' Pr m (A* m K*)h k+s (S k ,0, -,0) + Ri, s , 

where the sum extends over all combination of r\,...,r m > 2 ,m = 1 , 2 ,..., such that r\ + ... + 
r m < s and all ordered m - tuples of positive induces 1 < j r < m without repetition. Assume 
that for l = 3,..., s — 1 we have already proved that 

l -3 

(2.19) D a h n (ei,...,£ n ) = '^2P j (£*K*)h 0O + R lj i. 

j =0 

We start with the case 1 = 3, which follows from Theorem 12.11 Applying the induction 
assumption ([2.191) to ([2.181) we get 


h k (5 k ) ~ h k (6°k ) = X]iCA*^*) • • • Pr k (^*)P ro (£*^)hoo + Rl,s 
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where the sum extends over all indices n, r m > 1, ro > 0, such that tq + r\ + ... + r m < s. 
We shall rewrite this relation as follows 


s —4 


(2.20) h k (6 k ) - h k (S° k ) = E P ro (e*K*) E 

ro=0 j 


s—ro 

n 

i=i 


Vi =1 


n 


hoo H - Ri, a , 


s—r o 


where [ } r denotes all terms of the enclosed formal power series which are proportional to 
monomials A') 1 ... A')) 1 with r\ + ■ ■ ■ + r k < r and k < m. The right hand side of (12.201) may 
be expressed as 


koo T Ri t s 


s—4 


oo / k \ 


(2.21) Y P ro( £ * K *) 

exp 

E E A I A 

- 1 

r 0 =0 


P=2 \j=l / 



s—r o 


It is easy to see that 

and 

( 2 . 22 ) Y A j= £ i 

3 =1 

Using (12.161) we get 


3 = 1 


1 -A k ~ l 

k~ 1 ) + ~r 


= 0 


1 k ~ 1 

k p/2 1 + k p/2 


= -e p + 0 


I kP / 2 J 


, p > 2. 


Pr o(£*«*) 



oo f k \ 


exp 

E E a HA 

- 1 


P=2 \j=l / 



J s—ro 


s—ro —1 


^ro(e*«*) E p ( [E A 

U =1 

k 


3 


tv* I hn 


i=3 


(2.23) 

and 


P ro (£*K*)E 


2=1 




kJ =1 


s—ro —1 


( * \ 

r (* \i 

E A >* h oo = P r0 (e*K*) 

P r 1 E I 

W ' / 

L W / J 


^oo “ 1 “ 


s-r 0 -l 

By (12.231) - (12.241) we may rewrite (12.211) in the following way 

s—4 s—3—ro ( k \ 

hk(S k ) - h k (6 0 k ) = E P r 0 (£*«*) E E A A* ^oo + i*l„ 

ro=0 r=l \ j=l J 


Since 


E ^ , r(T*K*)Pg(r'K*) = Pfe((r* + r')/c*), q,r,k> 0. 

r+g=/c 
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we conclude 

M4) - h k (6l) = E l p r((£* - £*)«*) - Pr(e*K*)} hoo(Xi ,..., A fl )| Ai= =As=0 + R hs , 


s —3 


r =1 


where we have used (12.221) . 

Thus, we replaced e\ by {e\/y/k ,..., £\/Vk) and found a corresponding expansion. We 
shall now repeat the same procedure for the remaining Ej. 

For all j > 2 we replace £j by (fc _1 / 2 e 3 -,..., fc _1 / 2 £j). It is easy to see that replacing 
h n (£ i,-.,£n) by h"n-\-k—1 (5 k ,£ 2: -,e n ) with 

( 6 1 ,...,5 k ) = J 

we can use (12.191) with (<[/-,£p :n ]) instead of e, where ej 2:n ] := (£ 2j ...,£«)■ The function will 
be the same in both expansions since it depends on |e| 2 only and |<5 fc | 2 + |£[ 2:n ]| 2 = I+- The 
same arguments may be applied for all j > 2. Hence, repeating this procedure n — 1 times we 
get 


hnk 


£l £! 


-n G n 


•••? £n) 


Vk''"' Vk : '"’ Vk; 

n s —3 

E5^ [Tr((£[j:„] — e j) K *) ~ P r( £ [j :n ] K *) hoo(Xi, ., X s )\ x ^ = _ X ^ =Q + R s , 


j =1 r =1 


where £[ J:n ] := (e,,...,£„). 

To finish the proof we need to show that for fixed r the following identity holds 


(2.25) 


n 

E [ P r((4:n] “ 7+*) " = ~ P r{e*^). 


3 = 1 


The relation (12.251) follows from the following simple observation. Let m > 1 be a fixed integer 
and (j i,..., j m ) be a vector of positive numbers such that j\ + ... + j m = r. Then 


EK 


ji+2 71+2 


— £„■ 


(.£[i:n] 


jm~h 2 ^Jm+2 


i=1 

— _ 5 il+2 # # . £.jm~h 2 


Eii 

2—1 


Jl+2 




. Jm+2 
z:n 


For a proof it is enough to note that for all i > 1 

( e M 2 - £ f +2 ) • • • ( £ M Jm+2 - £- m+2 ) = £[i+l:+ 1+2 • • • £[*+ l-.n] J 

Applying (12.251) we arrive at 

h ( \ 7 ^1 ^1 

nl£ !, £nj " nfc V77 77 77 71 


s—3 


E P r(£*K*)hoo{ Al, A s )| 


Ai—A s —0 


+ 


r= 1 
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Repeating now the last two steps in the proof of the previous Theorem 12.11 and taking the 
limit k —>• oo we get 


s -3 

hn (£l j ■■ ■) £n ) hoo — ^ ( Pr N* )/loo (A}, Xg') | / \ 1= =^ s= o ^ s ' 

r =1 


This proves (12.1911 for l = s and a = 0. Hence, the induction is completed and the Theorem 
is proved. □ 


3. Application of Theorem f272l 

In this section we illustrate in some examples how one may apply Theorem 12.21 to derive 
an asymptotic expansion of various functions in probability theory. 


3.1. Expansion in the Central Limit Theorem for Weighted Sums. As the first exam¬ 
ple let us consider the sequence of independent random variables X,Xj,j £ N, taking values 
in M with a common distribution function F. Suppose the E X = 0,E1 2 = 1. Consider the 
weighted sum S e = £\X\ + ... + e n X n . As h n we may choose the characteristic function of S e , 
he., 

h n (e 1 ,...,e n ) = Ee ^Ai+.-+^). 


From Theorem 12.11 we know that /ioo(|e| 2 ) exists provided that the condition (12.21) holds. In 
our setting this condition holds when E |A'| 3 < oo . It is well known, see e.g. Ch.5 in m , that 


h 00 (\e\ 2 )=Ee itG , 


where G ~ IV(0, In what follows we shall assume \e\2 = 1. The rate of convergence is 

given by |£|jj. If £ is well spread, for example, when Ej = n ^ 1 ^ 2 for all 1 < j < n. then 


(3.1) 


\h n (£i,...,£ n ) - hoo (| £ 1 2 ) | < c ■ |t| c 


E\Xf 


n 


Of course this bound does not hold for all £ = (ei, ..., £ n ) on the unit sphere S n 1 = {s : \e \2 = 
1}. Consider a simple counter example. Let X Uniform([—\/3, \/3]) and £ = e\. Then 
S e = X\ ~ Uniform([—\/3, \/3]), which is not Gaussian as n A oo. 

Concerning expansions for weighted linear forms, results of nn imply that the left hand 
side of (13.11) has order 0(\jn) for a ’large’ set of unit vectors £. The size of this set is measured 
according to the uniform probability measure, say cr n _i, on the unit sphere S n ~ 2 . 

Let us now construct an asymptotic expansion using Theorem 12.21 We have for any integer 
s > 0 


hoo(Xi ,..., X s ) = Ee it(AlA ' 1+ - +AsXs+G ). 
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Taking derivatives with respect to Ai,A s at zero we get, for example, for s < 2 


d 3 
d\f 
d 4 
dXf 
d 4 


hoc (A i , 
hooi^ii 


Ai=0 


d\ 2 d\ 2 


Ai=0 

h Q o(Ai, A 2 ) 


qG 

d\ld \ 3 2 


MAi,A 2 ) 


{itfe * 2/2 /3 3 , 
(it) 4 e _42/2 /3 4 , 

= (itfe-*' 2 ft, 

Ai=0,A2=0 

Ai=0,A2=0 


where /?2 = EX 2 = l,/3 3 = EX 3 and /3 4 = EX 4 . Substituting these equations to (|2.12j) we 
get 

h n fii £n) = Ee ,tG + "—(itf e~* 12 

fa 

+ - 3](i«) 4 e-‘V2 + (M£(ii)6e-‘ 2 /2 + 

The expansion coincides with the well known Edgeworth expansion (involving cumulants) for 
characteristic functions of sums of random variables, see, e.g., § 1, Ch. 6, in m • It coincides 
as well with Edgeworth expansions for expectations of smooth functions of sums of random 
vectors in Euclidean, resp. Banach spaces, see e.g., |12] resp. [9]. 

Let us concentrate now on the so-called short asymptotic expansion 

(3.2) h n (e i,...,£ n ) = ~Ee ltG + ^ F (itfe~*/ 2 p 3 +R 4 , 

fa 


where 


\RP<C-\t\ 4 -J2< 


k=1 


It follows from m Lemma 4.1] that for some constants C\ and C 2 and for all 
p : 1 > p > exp(— C\ n) there exists a subset B C 5 n_1 such that for any e € B one has 


(3.3) 


£■ 

k=\ 




1\ 2 C 2 


n 


and 4 < ( log 


k=1 


1 


C 2 

n 


and a n -i(B) > 1 — p for the uniform probability measure a n -1 on the unit sphere S n 4 . 
Thus combining (13.21) and (13.31) we get for any p : 1 > p > 0, and all e € B 

(3.4) \h n (£i,...,£ n ) ~^e ltG \ < C (\t\ 3 + t 4 ) flog-'] — 

\ pj n 

for some constant C (cf. (13.11) 1. 

This property may be generalized to arbitrary functions h n (ei,...,e n ) which satisfies the 
conditions of Theorem 12.21 

Extending this example it is possible to apply our result for asymptotic expansion in the 
central limit theorem for quadratic forms in sums of random elements with values in a Hilbert 
space including infinite dimensional cases, see, e.g. [3], [llj, [Lj], [20], [21] and [22lj . 
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Moreover, our result could be helpful in study of asymptotic expansions for the functionals 
of weighted sums of dependent random variables. 

Let X\,, X n be identically distributed symmetric random variables and Si,...,S n be 
independent Rademacher random variables, i.e. 5i takes values 1 and —1 with probabilities 
1/2. Assume that 5±,... ,5 n are independent of X\, ..., X n . We emphasize that here it is not 
necessary that X\,... ,X n are independent. In order to in construct asymptotic expansions 
for Ei ? (ei X\ + • • • + e n X n ) with some smooth measurable function F. note that 

F{£! X 1 + • • ■ + e n X n ) = F{ £l <Ji X x + ■ ■ ■ + e n 6 n X n ), 

where = denotes equality in distribution. Consider functions 

M e L • • • j -n) — IE-F/gq S\ X\ -f- ■ ■ ■ T £ n X n ). 

The function h n satisfies the conditions m-m provided F is sufficiently smooth. 

For instance, we can take for i = 1,..., n 

X = Y1 

V £ l W H + £ n Yn 

where Yi,...,Y n are independent random variables with common symmetric distribution. 
Then F[e\ X\ + • • • + £ n X n ) is a function of a self-normalized weighted sum, see e.g. [L5j. 

On the other hand, in the special case £\ = ■ ■ ■ = £ n = 1/y/n we may consider F(Xi/y/n + 
• • • + X n /y/n) as a function of exchangeable random variables, see e.g. [10]. 

3.2. Expansion in the Free Central Limit theorem. It has been shown in a recent 
paper [13] that one may apply the results of Theorem 12.21 in the setting of Free Probability 
theory. 

Denote by A4 the family of all Borel probability measures defined on the real line R. 
Let Xi, X' 2 ,... be free self-adjoint identically distributed random variables with distribution 
g € M. We always assume that fi has zero mean and unit variance. Let fi n be the distribution 
of the normalized sum S n := I n f ree probability the sequence of measures fi n 

converges to Wigner’s semicircle law oj. Moreover, /i n is absolutely continuous with respect to 
the Lebesgue measure for sufficiently large n. We denote by the density of /j n . Define the 
Cauchy transform of a measure /u 



where C + denotes the upper half plane. 

In |S] Chistyakov and Gotze obtained a formal power expansion for the Cauchy transform 
of pL n and an Edgeworth type expansions for fx n and p^ n . In [13] the general scheme from [5] 
was applied to derive a similar result. 

3.3. Expansion of Quadratic von Mises Statistics. Let X, X,X±, ...,X n be independent 
identically distributed random elements taking values in an arbitrary measurable space 
Assume that g : X —>• R and LI’xI’-) R are real-valued measurable functions. In addition 
we assume that h is symmetric. We consider the quadratic functional 

n n 

^n(^l? ••• i £ri) — E'«(v)+ E £j £k h(yXj , Xk ) , 

k =1 _7,/c=l 
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assuming that 

E g(X) = 0, E(h{X,X)\X) = 0. 

We shall derive an asymptotic expansion of h n (e i, —,£ n ) ■= Eexp(itw n (£i, 

Consider the measurable space (X,B,/i) with measure /j := C(X). Let L 2 := L 2 (X,B,g) 
denote the real Hilbert space of square integrable real functions. A Hilbert-Schmidt operator 
Q : L 2 —>• L 2 is defined via 

Qf(x)=[ h(x,y)f(y)n{dy) = Eh(x,X)f(X), feL 2 . 

Jx 

Let {e-j , j > 1} denote a complete orthonormal system of eigenfunctions of Q ordered by 
decreasing absolute values of the corresponding eigenvalues qi,q 2 ,..., that is, |gi| > |^21 > •••• 
Then 

OO OO 

E h 2 {X,X) = ^q 2 < 00, h(x,y) = ^2 / q j e j (x)e j (y) 

3 =1 3 = 1 

If the closed span ({ej,j > 1}) C L 2 is a proper subset, it might be necessary to choose 
functions e_i, eo such that {ej, j = —1, 0,1,...} is an orthonormal system and 

OO OO 

g( x ) = ^ 2 gkek(x), h(x,x) = ^2 h kek(x). 

k =0 k =—1 


It is easy to see that E ej(X) = 0 for all j. Therefore {ej(X), j = —1,0,1,...} is an orthonormal 
system of mean zero random variables. 

We derive an expression for the derivatives of /ioo(Ai,..., X r ). Since for every fixed k the 
sum n~ 1 ^ 2 (e k (Xi) + ... + e k (X n )) weakly converges to a standard normal random variable we 
conclude that rc n+r (Ai,..., A r , n -1 / 2 ,..., n -1 / 2 ) weakly converges to the random variable 

OO OO 

^oo(Al, •••) 'V) := W r (X 1, ..., A r ) + ^ ' 9 k Y k T ^ ' QkO^k 1) 

k= 0 k= 1 

oo / r \ 

+ Eh(X,X) + 2 E® E XMXi) Y k , 

k =1 \z=i / 

where Y k , k > 0 are independent standard normal random variables. For every fixed T we get 
by complex integration 

Eexp [itq k {Y k - 1) + 2itTY k ] = — =1== exp (—itq k ) exp 
This yields 


2 t 2 T 2 

V 1 - 2it Qk 


(3.5) Loo(Ai,..., A r ) = <p(t) Eexp[itw r (Ai,..., A r ) 

OO 

+ (it) 2 ' 22 qkT k (X)( 2 q k T k (X) + g k )( 1 - 2 itq k )~\ 
k =1 

where T k ( A) = J2i=i A ie k (X t ) and 


99(f) 


OO 


n 


1 

\/l - 2 itq k 


exp (~itq k ) 


exp 


itEh(X 1 ,X 1 ) - t 2 ^2gl{ 1 - 2itq k ) 1 /2 

k =0 
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Let us introduce the following functions of X and X: 


h t (X, X) := h(X, X) + 2 it J2 qle k (X)e k {X)(l - 2 itq k )~\ 

k=1 

g t (X) := g(X) + it E (h t (X,X)g(X)\X). 

Applying these notations we may rewrite (ESI) in the following way 

n r 

hoo ( Ai 1 • j A 7 * ) — IE Gxp it ^ ^ (-Xji , X^Xj A/c + E A j9t(Xj 

j,k=l j=1 

Taking derivatives of with respect with Ai,A r at zero we get 

s —3 

/t n (ei, ...,£ n ) = </?(f)^a r (i, h,#) + R s , 


r =0 


where 


a r (f, h, g) := P r (e* k*) E exp it E ht {Xj , X k ) A j X k + it 'y ^ A j gt (Xj ) 

j,k =1 j=l Ai = ...=A r =0 

Higher order [/-statistics may be treated by similar arguments. See, for example, the result 
of [9] and p. 


3.4. Expansions for Weighted One Sided Kolmogorov-Smirnov Statistics. Let X\, ...X n 
be an independent identically distributed random variables with uniform distribution in [0,1]. 
Consider the following statistic D + (ei ,..., e n , t) = e ](MXj < t) — t ). For example, if 

Ej = n _1 / 2 ,j = 1, ...,n then we have D + (t) = n 1//2 (i ? n (t) — t ), where F n (t) denotes the empir¬ 
ical distribution function of X\,.... X n . We are interested in the asymptotic expansion of 

F( sup D + (ei, ..., e n , t) > a), a > 0. 

0<t<l 


It is well known that hoo(0) = exp [—2a 2 ] and 


Hr 


>(A) = f 

Jo 


(x(t) + A(I(s < t) — t) > a, 0 < t < 1) ds 


= / E/ a (s,x(s),A)/ a (l - s,x(s),-X)ds, 

Jo 

where f a (s,x, A) = P(x(t) > a + Xt,0 <t < s|x(s) = x) = exp(—2a(a + As — x)/s) and 
x(t) , 0 < t < 1 is a Brownian bridge. For more details, see [8j. Then it follows from Theorem l2.2l 
that 

1 + + C>(|e||) exp(—2a 2 ). 


(sup D + (ei, ...,e n ,t) > a) = 
0<t<l 


Such expansions for equal weights have been derived for example by combinatorial and analytic 
techniques in PH and p. 
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